COMPLETE REDUCIBILITY AND CONJUGACY CLASSES OF TUPLES 
IN ALGEBRAIC GROUPS AND LIE ALGEBRAS 



MICHAEL BATE, BENJAMIN MARTIN, GERHARD ROHRLE, AND RUDOLF TANGE 

Abstract. Let H he a reductive subgroup of a reductive group G over an algebraically 
closed field k. We consider the action of H on G", the n-fold Cartesian product of G with 
itself, by simultaneous conjugation. We give a purely algebraic characterization of the closed 
iJ-orbits in G", generalizing work of Richardson which treats the case H = G. 

This characterization turns out to be a natural generalization of Serre's notion of G- 
complete reducibility. This concept appears to be new, even in characteristic zero. We 
discuss how to extend some key results on G-complete reducibility in this framework. We 
also consider some rationality questions. 



Let G be a reductive linear algebraic group over an algebraically closed field, and suppose 
G acts on an afiine variety V. A fundamental problem in geometric invariant theory is to 
determine the closed orbits of G in These orbits correspond to the points in the quotient 
variety V//G, so this is the first step towards understanding the geometry of the quotient. 
Often it is of particular interest to find the open subset of stable orbits, which consists of 
points on which the quotient map tt: V ^ V// G is especially well-behaved. Moreover, once 
the closed orbits are known, one can study degeneration phenomena: the way in which a 
point in a non-closed orbit can be brought inside a closed orbit by taking a limit along a 
cocharacter. 

An important family of examples arises as follows. Take G to be a subgroup of GL(14^) 
for some finite-dimensional vector space W, choose a subvariety C of End(Vr) that is sta- 
ble under conjugation by G, and take V to be G" for some n G N, where G acts on G"" 
by simultaneous conjugation. Typically G carries some algebraic structure: it might be a 
subgroup of GL(Vl^), or a Lie subalgebra or associative subalgebra of End(iy). For instance. 



if G = GL{W) and G = End{W), then, by work of H. Kraft (dH Prop. 4.4] or ^ 11.2.7 
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1. Introduction 
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Satz 2]), for any v = (ci, . . . , c„) G = the orbit G ■ v is closed if and only if W is 
semisimple as an A-module, where A is the associative subalgebra of End(iy) generated by 
ci, . . . , Cn; moreover, if G ■ w is not closed, then the degeneration process referred to above is 
the "semisimplification" , in which one replaces the A-module W with the direct sum of its 
composition factors ([HI Prop. 4.5] or [12, II. 2. 7 Satz 3]). 

Now consider the case when C = G. In his seminal work [2^ Thm. 16.4], Richardson gave 
an algebraic characterization of the closed G-orbits in G". In [21 Thm. 3.1] it was shown that 
his criterion for an orbit to be closed can be formulated using the representation-theoretic 
notion of G-complete reducibility due to Serre, [25|. This concept has been much studied and 
it has proved a useful tool for exploring the subgroup structure of simple algebraic groups 
[13] . [H], [15], [23], [21], [26], [27]. The approach to G-complete reducibility via geometric 
invariant theory has proved very fruitful, cf. ^2], [3], [5], and [6]. 

It is natural to extend Richardson's study and determine the closed if -orbits in G" for an 
arbitrary reductive subgroup H of G. In this paper we show that there is also an algebraic 
interpretation of the closed orbit condition in this case. We introduce the notion of a relatively 
G-completely reducible subgroup of G with respect to H (Section 13. ip and prove the following 
result (see Theorem 13. 5p . 

Theorem 1.1. Let H be a reductive subgroup of G. Let K be the algebraic subgroup of G 
generated by elements xi, . . . , € G. Then H ■ (xi, . . . , x„) is closed in G" if and only if K 
is relatively G-completely reducible with respect to H. 

This generalizes Richardson's result [22[ Thm. 16.4] which is the special case of Theo- 
rem 11.11 when H = G. 

Note that we can embed G in some GL(l^), so this fits into the general setting discussed 
above (take G = G and replace G with H). In fact, we can take G to be equal to GL(Vr) if 
we wish (cf. Corollary I3.6p . 

The definition of G-complete reducibility involves cocharacters of G. Theorems about G- 
complete reducibility often involve taking not arbitrary cocharacters of G but cocharacters of 
a proper reductive subgroup H of G (see [5l Prop. 5.7], for example). The notion of relative 
complete reducibility gives a systematic way to formalise such arguments: hence our results 
are of interest even if one is concerned mainly with G-complete reducibility. 

Armed with Theorem II. H we explore some basic properties of relative G-complete re- 
ducibihty in Section |3l We study the extent to which results about G-complete reducibility 
extend to relative G-complete reducibility, concentrating on what happens when one varies H 
or other parameters in the definition. Returning briefly to the more general setting described 
above, we extend the notion of relative G-complete reducibility to certain Lie algebras and 
associative algebras associated to G: for instance, we consider the case when G is the as- 
sociative subalgebra of End(Vr) spanned by G. We also characterize the ii-stable orbits in 
G" in terms of this notion of relative G-complete reducibility (Proposition 13.16]) : this gener- 
alizes Richardson's result for the special case H = G, [221 Prop. 16.7]. From this we deduce 
Theorem I3.19[ a group-theoretic analogue of the fact that the closure of an ii-orbit in G" 
contains a unique closed ii-orbit. The other main results in Section [3] are Theorems 13.211 
and 13.251 and Proposition 13.331 

In Section HJ we define relative G-complete reducibility over an arbitrary field. We answer 
a generalization of a question due to Serre about the behaviour of G-complete reducibility 
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under separable field extensions (Theorem 14.131) . We discuss the formalism of optimal desta- 
bilizing R-parabolic subgroups and give an application (Theorem I4.14p . We finish the paper 
with a section containing a collection of examples. In particular, we study the case of rel- 
ative GL(W^)-complete reducibility and give some characterizations in terms of the natural 
module W. 

2. Notation and preliminaries 

2.1. Basic notation. Let k be an algebraically closed field, and let if be a linear algebraic 
group defined over k. All varieties are affine varieties over k unless otherwise noted. We let 
Z{H) denote the centre of H and the connected component of H that contains 1. By 
a subgroup of H we mean a closed subgroup. If i^' is a subgroup of H, then Ch{K) is the 
centralizer of in if and Nh{K) is the normalizer of K in H. We say that H is linearly 
reductive if every rational representation of H is semisimple. 

For the set of cocharacters (one-parameter subgroups) of H we write Y{H)] the elements 
of Y{H) are the homomorphisms from k* to H. There is an action of H on Y{H) given by 
(h ■ A)(a) = hX{a)h-^ for A G Y{H), h e H and a e k*. 

The unipotent radical of H is denoted Ru{H)] it is the maximal connected normal unipo- 
tent subgroup of H. The algebraic group H is called reductive if Ru{H) = {1}; note that H 
is reductive if and only if if° is reductive. 

Throughout the paper, G denotes a reductive algebraic group, possibly non-connected. 
We denote the Lie algebra Lie G by g, and likewise for subgroups of G. We define Matm to 
be the associative algebra of m x m matrices over k. 

Frequently, we consider the diagonal action of G on G", the n-fold cartesian product of G 
with itself, by simultaneous conjugation: 

g ■ (xi, . . . , Xn) := i9Xig'\ . . . , gx^g''^), 

for all g E G and (xi, . . . , x„) G G^. Note that any subgroup H of G acts on G^ in the same 
way. We also consider the action of G on by diagonal simultaneous adjoint action. 

Let A be an algebraic group, a Lie algebra or an associative algebra. If n G N and 
X = (xi, . . . , Xn) G v4", then we say that x generates A if the Xi generate A as an algebraic 
group (resp. Lie algebra, resp. associative algebra). By this we mean in the algebraic group 
case that the algebraic subgroup of A generated by the Xj is the whole of A, and we say that 
the algebraic group A is topologically finitely generated. 

2.2. Non-connected reductive groups. Since we want to work with reductive groups 
which are not necessarily connected, we need to extend several familiar ideas from connected 
reductive groups. The crucial ingredient of this extension is the introduction of so-called 
Richardson parabolic subgroups {R-parabolic subgroups) of the reductive group G. We briefly 
recall the main definitions and results; for more details and further results, the reader is 
referred to [H Sec. 6]. 

Definition 2.1. For each cocharacter A G Y{G), let Px = {g E G \ Urn X{a)gX{a)~^ exists} 

a— >0 

(for the formal definition of such limits, see Definition I2.2p . Recall that a subgroup P of G 
is parabolic if G/P is a complete variety. The subgroup Pa is parabolic in this sense, but 
the converse is not true: e.g., if G is finite, then every subgroup is parabolic, but the only 
subgroup of G of the form Px is G itself. We define Lx = {g E G \ lira \( a) g\(a)~^ = g}. 

a-i-O 
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Then Lx is a reductive subgroup of G and we have Lx = CciXik*)) and Px = Lx^ Ru{Px)- 
We also have RJPx) = {g & G \ \im \( a) g\(a)~^ = 1}. The map cx'- Px ^ Lx given by 

cx{g) = hm X{a)gX{ay^ 

a— >-0 

is a surjective homomorphism of algebraic groups with kernel Ru{Px)', it coincides with the 
usual projection Px ^ Lx- We abuse notation and denote the corresponding map from 
to by Cx as well, for any n eN. The subgroups Pa for A G Y{G) are called the R-parabolic 
subgroups of G. Given an R-parabolic subgroup P, an R-Levi subgroup of P is any subgroup 
Lx such that A G and P = Px- Note that if P, Q are R-parabolic subgroups of G 

with P° = (5°, then Ru{P) = Ru{Q)- If G is connected, then the R-parabolic subgroups 
(resp. R-Levi subgroups of R-parabolic subgroups) of G are exactly the parabolic subgroups 
(resp. Levi subgroups of parabolic subgroups) of G; indeed, most of the theory of parabolic 
subgroups and Levi subgroups of connected reductive groups carries over to R-parabolic and 
R-Levi subgroups of arbitrary reductive groups. In particular, Ru{P) acts simply transitively 
on the set of all R-Levi subgroups of an R-parabolic subgroup P. Also note that Pa = G if 
and only if A is central in G [21 Lem. 2.4]. When it does not cause any confusion, we speak 
of "R-Levi subgroups of G" when we mean "R-Levi subgroups of R-parabolic subgroups of 
G". 

In this paper, we are interested in reductive subgroups of reductive groups. If if is a 
subgroup of G, then there is an obvious inclusion Y{H) C Y{G) of the sets of cocharacters. 
When H is reductive and A G Y{H), there is then an R-parabolic subgroup of H associated 
to A, as well as an R-parabolic subgroup of G. In order to distinguish between R-parabolic 
subgroups associated to different subgroups of G, we use the notation Px{H), Lx{H), etc., 
where necessary, but we write Pa for Pa(G) and Lx for LxiG). Note that Px{.H) = PxH H, 
Lx{H) = LxnH and Ru{Px{H)) = P„(Pa) n H. 

2.3. Groups acting on varieties. We recall some general results from geometric invariant 
theory required in the sequel, see [6], [U §2], |T9], and |20l Ch. 3]. 

Definition 2.2. Let (p : k* ^ V he a morphism of algebraic varieties. We say that lim0(a) 

exists if there exists a morphism (p : k ^ V (necessarily unique) whose restriction to k* is 0; 
if this limit exists, then we set lim0(a) = 0(0). 

a— s>0 

Now suppose the reductive group G acts on a variety V. For v & V let G ■ v denote the 
G-orbit of w in and Cg{v) the stabilizer of v in G. It follows easily from Definition 12. 21 that 
if lim A (a) ■ v exists for a cocharacter A G Y(G), then this limit belongs to the closure G ■ v 

ofG-vinV. The well-known Hilbert-Mumford Theorem Thm. 1.4], gives a converse to 
this: if f G y is such that G ■ f is not closed in V, then there exists a cocharacter A G Y{G) 
such that lim A (a) ■ v exists and lies in the unique closed G-orbit contained in G ■ v. 

We often use the following simple lemma in the sequel, [6l Lem. 2.12]. 

Lemma 2.3. Suppose G acts on a variety V. Let v let X & Y{G) and let u G Ru{Px)- 
Then limA(a) ■ v exists and equals u ■ v if and only if ■ X centralizes v. 

a->-0 

The next result is [6, Thm. 3.3] in case k = k. 
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Theorem 2.4. Suppose G acts on a variety V. Let v ^ V and let A G Y{G) such that 
v' := limA(a) • v exists and is G-conjugate to v. Then v' is RuiPx)- conjugate to v. 

a-i-O 

2.4. Generic tuples. In order to establish the link between relative G-complete reducibility 
with respect to H and i^-orbits of tuples needed for Theorem II. we require the following 
notion of a generic tuple, see P Def. 5.4]. 

Definition 2.5. Let K he a, subgroup of G and let G GL^ be an embedding of algebraic 
groups. Then k G is called a generic tuple of K for the embedding G GL^ if k 
generates the associative subalgebra of Mat^ spanned by K. We call k G a generic tuple 
of K if it is a generic tuple of K for some embedding G GL^. 

Clearly, generic tuples exist for any embedding G GL^ for n sufficiently large. The 
main properties of generic tuples are given by the next lemma, which is |6l Lem. 5.5]. 

Lemma 2.6. Let K he a subgroup of G, let k G be a generic tuple of K for some 
embedding G ^ GL^ and let K' be the algebraic subgroup of G generated by k. Then we 
have: 

(i) Ci/(k) = Ch{K') = Ch{K) for any subgroup H of G; 

(ii) K' is contained in the same R-parabolic and the same R-Levi subgroups of G as K; 

(iii) If K ^ Px for some A G Y{G), then cx{\<.) is a generic tuple of cx{K) for the given 
embedding G GL^ . 

Remark 2.7. If i^' is a subgroup of G which is topologically generated by a tuple k G K"', 
then k is a generic tuple of K in the sense of Definition 12.51 [6l Rem. 5.6]. 

3. Relative G-complete reducibility 

3.1. Relative G-complete reducibility. The key idea for the proof of Theorem I l.H which 
is proved in the next subsection, is the notion of relative G-complete reducibility, defined 
below. 

Definition 3.1. Let K he a subgroup of G and let H he any reductive subgroup of G. We 
say that K is relatively G-completely reducible with respect to H if for every A G Y{H) such 
that K is contained in P\, there exists /x G Y{H) such that Pa = Pfi and K C L^j^. We 
sometimes use the shorthand relatively G-cr with respect to H. 

Remarks 3.2. (i). In the case H = G, Definition 13.11 coincides with the usual definition of 
G-complete reducibility |2, Sec. 1], |27, 3.2]; we sometimes refer to this as the absolute case. 
Note that a subgroup of G is relatively G-completely reducible with respect to H if and only 
if it is relatively G-completely reducible with respect to H^. Thus we may assume without 
loss that H is connected. If is central in G, then every subgroup of G is relatively 
G-completely reducible with respect to H. 

(ii) . li K ^ H, then K is relatively G-cr with respect to H if and only if K is H-cr (this 
follows from Lemma [3.3( ii) below). 

(iii) . In characteristic zero a subgroup of G is G-completely reducible if and only if it is 
reductive (cf. [21 Lem. 2.6]). We don't know of any simple characterization of relative G- 
complete reducibility in this case (this complicates the proof of Proposition 13 . 33 p . So relative 
G-complete reducibility appears to be a new notion even in characteristic zero. 
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(iv) . We note that one of the basic properties [271 Prop. 4.1] of G-cr subgroups is not 
inherited by relatively G-cr subgroups in general: if we take H C Z{G), then all subgroups 
of G are relatively G-cr with respect to H. In particular, it is possible for non-reductive 
(even unipotent) subgroups to be relatively G-cr with respect to a subgroup H. 

(v) . As noted in (iv), in general a relatively G-cr subgroup of G need not be G-cr. Also 
a G-cr subgroup need not be relatively G-cr. For instance, let L be an R-Levi subgroup of 
some R-parabolic subgroup P of G. Then L is G-cr by [271 Prop. 3.2], [2, §6.3]. Let M be 
any other R-Levi subgroup of P. Then for any maximal torus T of G that lies in M we have 
that L is not relatively G-cr with respect to T. For there exists A G Y{T) with P = P\ and 
for any such A, we have L\ = M hy ^ Cor. 6.5]; hence L ^ L\. Here is another example: 
there exists reductive G with a reductive subgroup H and a subgroup K of H such that K 
is G-cr but not H-ci jSJ Prop. 7.7]; then K is not relatively G-cr with respect to H by (ii) 
above. 

For examples of relatively G-cr subgroups, see Section \5\ where we specifically study the 
case when G = GL(l^). 

The following lemma gives some detailed information about conjugacy of R-Levi subgroups 
in the subgroups Pa and Px{H) for A G ^(-f^)- 

Lemma 3.3. Let H he a reductive subgroup of G. 

(i) Let A,;U G y{H) such that P\ = P^ and let u he the element of Ru{P\{H)) such that 
uL\{H)u~^ = L^{H). Then uL\u'^ = L^. 

(ii) Let K be a subgroup of G. Then K is relatively G- completely reducible with respect to 
H if and only if for every A G Y{H) such that K C P^^ there exists u G Ru{P\{H)) 
such that K C L^-x- 

Proof, (i). Set = m ■ A; then /i' G Y{H), since u G Ru{Px{H)). We have L^.{H) = 
uLxu^^ = Lf^{H), so fi, fi' G Y {Z {L f^{H))^) . Let T be a maximal torus of containing 
Z{Lfj_{H))^ . Then since ji' G Y{T), we have T C L^/, and L^i is an R-Levi subgroup of Pa- 
Thus and L^/ are R-Levi subgroups of Pa containing a common maximal torus, so they 
are equal, by |2l Cor. 6.5]. 

(ii). This is clear from part (i) and Definition 13.11 □ 

Remark 3.4. Let if be a reductive subgroup of G. Let be a subgroup of G, let k G 
be a generic tuple of K and let K' be the algebraic subgroup of G generated by k. Then it 
follows from Lemma I2.6( ii) that K is relatively G-cr with respect to H if and only if K' is. 

3.2. Relative G-complete reducibility and closed orbits. Throughout the rest of this 
section, H denotes a reductive subgroup of G. The following result is |6l Thm. 5.8] gener- 
alized to our relative setting. In view of Remark 12. 7[ the final assertion in part (iii) gives 
Theorem 11.11 The proof of [6^ Thm. 5.8] goes through here with the obvious modifications 
and alterations of notation, replacing [6l Thm. 3.3] with Theorem 12.41 and [6l Lem. 5.5] with 
Lemma 12.61 

Theorem 3.5. Let H be a reductive subgroup of G. 

(i) Let n G N, /e^ k G G" and let A G Y{H) such that m := lima_j.oA(a) ■ k exists. Then 
the following are equivalent: 
(a) m is H- conjugate to k; 
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(b) m is Ru{Px{H))- conjugate to k; 

(c) dim H ■ m = dim H ■ k. 

(ii) Let K be a subgroup of G and let A G Y{H). Suppose K C and set M = c\{K). 
Then dim Ch{M) > dim Ch{K) and the following are equivalent: 

(a) M is H-conjugate to K; 

(b) M IS Ru{P\{H)) -conjugate to K; 

(c) K C for some n G Y{H) such that Px = P^; 

(d) dim Ch{M)= dim Ch{K). 

(iii) Let K , A and M be as in (ii) and let k G K'"- be a generic tuple of K. Then the assertions 
in (i) are equivalent to those in (ii). In particular, K is relatively G- completely reducible 
with respect to H if and only if H ■ k is closed in G^. 

Corollary 3.6. Let M be a reductive subgroup of G. Let K and H be subgroups of M and 
assume that H is reductive. Then K is relatively G-completely reducible with respect to H if 
and only if it is relatively M -completely reducible with respect to H . 

Proof. Clearly, if k is a generic tuple of K with respect to an embedding of G in GL,„, then it 
is a generic tuple of K with respect to the embedding of M in GL^ obtained by restriction. 
Since a subset of is closed if and only if it is closed in G"^, the result follows immediately 
from Theorem [STST iii). □ 

We have an analogue of part of Prop. 3.12]: 

Corollary 3.7. Let H be a reductive subgroup of G, and let K be a subgroup of G which is 
relatively G-completely reducible with respect to H . Then Ch{K) is reductive. 

Proof. Let k be a generic tuple of K. Since K is relatively G-cr with respect to iJ, the orbit 
i7 • k is closed in G^, by Theorem I3.5( iii). and therefore afiine. Hence C/f(k) = Ch{K) is 
reductive, by [HI Lem. 10.1.3]. □ 

3.3. Relative G-complete reducibility for Lie subalgebras of g. It is straightforward 
to extend our definitions and results to Lie subalgebras of g. We first record a standard 
result which gives some properties of the Lie algebras of R-parabolic and R-Levi subgroups 
of G (cf. [221 §2.1]). 

Lemma 3.8. For A G Y{G), put px = Lie(PA) o-'nd [\ = hie{Lx). Let x G g. Then 

(i) X Epx if and only if lim A (a) ■ x exists; 

a— ^0 

(ii) X Eix if and only if lim A(a) ■ x exists and equals x if and only if X{k*) centralizes x; 

a— >0 

(iii) X G Lie(i?„(PA)) if o-nd only if lim A(a) ■ x exists and equals 0. 

a— >-0 

Definition 3.9. For A G y{G) define the subalgebras pA and Ia of q as in Lemma 13.81 
Let € be a subalgebra of q and let H be any reductive subgroup of G. We call t relatively 
G-completely reducible with respect to H if for every A G Y{H) such that t C pA, there exists 
fi G y{H) such that Pa = Pfi and { C In case H = G, we say t is G-completely reducible. 

The following can be shown with the same arguments as Theorem 13. 5[ We emphasize that 
Theorem I3.10( iii) characterizes the closed if-orbits in g". We define the map ca: Pa — ^ h 
for Lie algebras in the obvious way (cf. Section [212]) • 



Theorem 3.10. Let H be a reductive subgroup of G. 
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(i) Let n G M, let k & and let A G Y{H) such that m := linia^o -^(c^) ■ k exists. Then 
the following are equivalent: 

(a) m is H- conjugate to k; 

(b) m is Ru{P\{H)) -conjugate to k; 

(c) dim H ■ m = dim H ■ k. 

(ii) Let t be a Lie subalgebra of g and let X G Y{H). Suppose t px and set m = cx{t). 
Then dimCH(m) > dimC//(t) and the following are equivalent: 

(a) m is H-conjugate to t; 

(b) m is Ru{P\{H)) - conjugate to t; 

(c) ^ C for some /i G Y{H) such that Px = P^; 

(d) dimCnim) = dim C nit)- 

(iii) Let t, A anc? m &e as in (ii), and suppose k G zs a generating tuple for t for some 
n E N. Then the assertions in (i) are equivalent to those in (ii). In particular, t is 
relatively G-completely reducible with respect to H if and only if H ■ k is closed in g". 

Remark 3.11. For H = G, Definition 13.91 is due to G. McNinch, [TS]. The final statement 
of Theorem I3.10( iii) generahzes [TSl Thm. 1(1)] which is the case H = G. Note also that 
Theorem I3.1UI generalizes JE\ Thm. 5.26] which is the case H = G. 

3.4. Relative G-complete reducibility for associative subalgebras of End(l^). Let 
G = GL(V^) and let H be any reductive subgroup of G. Using the characterization of 
parabolic and Levi subgroups of G in terms of flags in V, we see that pA and Ix, for A G Y{H), 
are associative subalgebras of End(V^). This means that one can deflne the notion of relative 
G-complete reducibility with respect to H for associative subalgebras of End(K) in the obvious 
way. Observe that in the absolute case, i.e., when H = GL(V^), we obtain that an associative 
subalgebra A of End(V) is G-completely reducible precisely when is a semisimple A- 
module. 

Obviously, a subgroup of G or a Lie subalgebra of g = QliV) is relatively G-cr with respect 
to H if and only the same holds for the associative subalgebra of End(y) that it generates. 
If i^' is a subgroup of G which is topologically generated by a tuple k G K^, then k generates 
the associative subalgebra of End(^) generated by K (cf. Remark 12. 7p . Similarly, if t is a 
Lie subalgebra of g which is generated by a tuple k G t", then k generates the associative 
subalgebra of End(\^) generated by i. 

If a tuple a G End(\^)'^ generates the associative subalgebra A of End(l^), then the 
analogue of Theorem 13.51 holds; in particular, A is relatively G-cr with respect to H if and 
only if if ■ a is closed. Therefore, in the absolute case H = G = GL(^), the final statement 
of the analogue of Theorem I3.5( iii) in this setting recovers a fundamental result in the 
representation theory of associative algebras due to H. Kraft: V is a. semisimple A-module 
if and only if the G-orbit G ■ a is closed in End(l^)'', see dH Prop. 4.4] or [El 11.2.7 Satz 
2]. In that sense, this concept of relative GL(V")-complete reducibility with respect to H for 
associative subalgebras of End(V^) generalizes this work of Kraft. 

3.5. iL-stable points in G" and relative G-irreducibility vi^ith respect to H. Recall 
the notion of a stable point for the action of a reductive group G on a variety V f2T\ 1.4]: 

Definition 3.12. Let Z = f]^^Y Gg{v) be the kernel of the action of G on V. We say that 
f G is a stable point for the action of G or a G-stable point provided the orbit G ■ v is 
closed in V and Cg{v)/Z is finite. 
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Remark 3.13. Let V//G be the variety corresponding to the fc- algebra fc[V^]^ and let n : V ^ 
V//G be the morphism corresponding to the inclusion /c[V^]'^ — )■ k[V]. In general, vr is not a 
quotient morphism in the sense of ^ §6] because vr might have a fibre which is the union of 
more than one G-orbit. Let denote the set of G-stable points in V. Then is a (possibly 
empty) G-stable open subset of V and = 7r^-'^(7r(V"'^)). Further, vr(V^'^) is an open subset 
of V//G and is a geometric quotient of G. For t> G V"'^, we have G ■ v = tt^^{tt{v)) (see [Ml 
Sec. 4]). 

In [221 Prop. 16.7], Richardson characterizes the G-stable points in G"". We can easily 
extend this result to the if-stable points in G"^ for reductive subgroups H of G. To do this, 
we first extend the notion of G-irreducibility from [271 §3-2] to the relative setting: 

Definition 3.14. Let H and K be subgroups of G with H reductive. We say that K is 
relatively G -irreducible (G-ir) with respect to H if whenever A G Y{H) and K C P^, we have 
Px = G. For H = G, this relative notion agrees with that of G-irreducibility, cf. [271 §3-2], 
[2i §2.4]. 

Remark 3.15. Obviously, relative G-irreducibility with respect to H implies relative G- 
complete reducibility with respect to H. It is clear that for subgroups H, K and M of 
G with H and M reductive and H,K ^ M, if K is relatively G-irreducible with respect to 
H, then K is relatively M-irreducible with respect to H, cf. [2, Cor. 2.7]. 

The notion of relative G-irreducibility is exactly what we need to characterize if-stability 
in G". In view of Remark 12.71 our next result generalizes [22l Prop. 16.7]; see also [2^ Prop. 
2.13]. Since Richardson's proof applies mutatis mutandis, we do not include it. 

Proposition 3.16. Let H be a reductive subgroup of G. Let K be a subgroup of G and let 
k G K"- be a generic tuple of K. Then K is relatively G-irreducible with respect to H if and 
only ifh is an H -stable point in G". 

The following provides analogues of Corollaries 3.22 and 3.5 of [2]. 

Proposition 3.17. Let H and K be subgroups of G and suppose that H is reductive. 

(i) Let S be a torus of Gh{K) and set L = Cg{S). Then K is relatively G-completely 
reducible with respect to H if and only if K is relatively L-completely reducible with 
respect to H n L. 

(ii) The R-Levi subgroups of G for ^ G Y{H) that are minimal with respect to containing 
K are precisely the subgroups of the form Gg{S) where S is a maximal torus ofGuiK). 
If L is such an R-Levi subgroup of G, then K is relatively G-completely reducible with 
respect to H if and only if K is relatively L-irreducible with respect to H (1 L. 

Proof. First we prove the first assertion of (ii). If S' is a torus in G, then Gg{S) = L\ for 
some A G Y{S) by the arguments of the proof of [21 Cor. 6.10]. Now assume that is a 
maximal torus of Gh{K). If G Y{H) such that K C C GciS), then ^{k*) commutes 
with S and is contained in Gh{K)- So, by the maximality of S, jiik*) C S and = Gg{S). 

Now assume that A G Y{H) and L\ is minimal among the R-Levi subgroups of G with 
/i G Y{H) and K C L^. Put S = {Z{Lx) n Hf. Then one easily checks that Lx = Gg{S). 
Let T be a torus of Gh{K) with S CT. Then K C Gg(T) C Gg{S) = Lx- As we have seen 
above, Cg{T) = for some /i G Y(T) C Y{H). So, by the minimality of Lx, Cg{T) = Lx 
and T C S. So S is a maximal torus of Gh{K). 
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To prove (i) and the second assertion of (ii) let k be a generic tuple of K. Let S* be a torus 
of Ch{K) and let L = CciS). Note that H D L = CniS) is reductive. By Theorem 13. 5( iii). 
K is relatively G-completely reducible with respect to H if and only if if ■ k is closed in 
and likewise if we replace G and H hj L and H (1 L, respectively. So (i) now follows from 
[HI Thm. C]. 

Now assume that S" is a maximal torus of Ch{K). Then if ■ k is closed in if and only 
if k is a stable point for the (if fl L)-action on L" by [221 Lem. 16.6]. By Proposition I3.16[ 
this is equivalent to K being relatively L-irreducible with respect to if fl L. □ 

Lemma 3.18. Let H be a reductive subgroup of G and let A G Y{H). Then the R-parabolic 
subgroups of G contained in P\ with jj, G Y{H) are precisely the subgroups of the form 
Q X Ru{Px), where Q = P,{Lx) and v G Y{Lx{H)). 

Proof. If /i G Y{H) such that P^ C Px, then is of the stated form if some Ru{P\{H))- 
conjugate of P^ is of this form. Now we can replace fi with an Ru{Px{H))-con^xigate which lies 
in Y{Lx{H)). The rest of the proof is completely analogous to that of [2|, Lem. 6.2(ii)]. □ 

We can now generalize [6l Prop. 5.14], showing that we can associate to each if-conjugacy 
class of subgroups of G a unique if-conjugacy class of subgroups which are relatively G-cr 
with respect to H; Theorem 13.191 below is the group-theoretic analogue of the statement that 
the closure of each if -orbit in G" contains a unique closed if -orb it. 

Theorem 3.19. Let if and K be subgroups of G and suppose that if is reductive. 

(i) There exists A G Y{H) and a subgroup MofG which is relatively G- completely reducible 
with respect to if such that K (1 Px and cx{K) = M. Moreover, M is unique up to 
H-conjugacy and its H-conjugacy class depends only on the H-conjugacy class of K. 

(ii) Any automorphism of the algebraic group G that normalizes H and stabilizes the if - 
conjugacy class of K, stabilizes the H-conjugacy class of M. 

(iii) If n E Y{H) and K C P^, then the procedure described in (i) associates the same 
H-conjugacy class of subgroups to K and c^{K). 

Proof. Let A G Y{H) be such that Pa is minimal among the R-parabolic subgroups P^ of G 
with fi G Y{H) and K (1 P^. Then Px is also minimal among the R-parabolic subgroups 
Pfj, of G with /i G Y{H) and Cx{K) C P^ by the same arguments as in the proof of [HI 
Prop. 5.14]. It now follows from Lemma 13.181 that cx{K) is relatively L^-irreducible with 
respect to Lx{H). But then cx{K) is relatively G-cr with respect to if by Proposition 13 . 1 7( i) . 

The rest of the proof is completely analogous to that of [6, Prop. 5.14]. One has to 
conjugate with elements from Ru{Px{H)) rather than Ru{Px)- The cocharacters A and fi 
in the proof of [6l, Prop. 5.14] can now be put in a common maximal torus of Px{H) and 
P,{H). □ 

Remark 3.20. A statement analogous to Theorem 13.191 holds for Lie algebras: that is, given 
any Lie subalgebra t of g, we can find a uniquely defined if-conjugacy class of subalgebras 
of which contains cx{i) for some A G Y{H), each member of which is relatively G-cr with 
respect to if. 

3.6. Optimal parabolic subgroups. Let i^ be a subgroup of G. If K is not relatively G-cr 
with respect to if, then there exists at least one cocharacter A G Y{H) such that K C Px, 
but K ^ Lu-x for any u G Ru{Px{H)). Following work in [Bl Sec. 5], we now show how to 
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make a so-called optimal choice for this A G Y{H); being able to make such a choice has 
many advantages and shortens some of the proofs which follow. Since the constructions we 
are going to discuss are very similar to those in [6j Sec. 5], where the case of a non-G-cr 
subgroup of G is addressed, we omit some details and content ourselves with pointing out 
the necessary modifications to allow the results to go through here. The constructions below 
in the special case H = G agree with those of loc. cit. 

We first need to adapt some of the notation from [HI Sec. 4, Sec. 5] to the relative setting. 
Suppose K is a. subgroup of G and suppose A e Y[H) is such that K <Z P^. Set M := c\{K) 
and let Sn{M) = H ■ M". Then K"" is a uniformly S'„(M) -unstable set for the action of H 
on G^ in the sense of P, Sec. 4]. Any G-invariant norm on Y{G) in the sense of [HI Def. 4.1] 
restricts to an A'"G(if)-invariant norm on Y{H); let || || be such a norm. Then [51 Sec. 4] 
provides a set fl{K"', Sn{M)) of cocharacters of H, the so-called optimal class (note that this 
depends on H, n and || || as well as M, but we suppress these other dependences in this and 
subsequent notation; cf. |6l Rem. 5.22]). Similarly, if Hs a Lie subalgebra of q and A G Y{H) 
is such that t C p;^, then setting m := cxit) and S'„(m) = H ■ m", we get an optimal class 
fi(r,S'„(m)) CF(i7). 

We have the following analogue of [6l Thm. 5.16] in the relative setting: 

Theorem 3.21. Let K he a subgroup of G and let n E N such that contains a generic 
tuple of K. Let M be a subgroup of G and suppose that M = cx{K) for some A G Y{H) with 
K CPx. Put Q{K, M) := Q{K'' , Sn{M)) . Then the following hold: 

(i) P^ = Py for all /U, G M). Let P{K, M) denote the unique R-parabolic subgroup 
of G so defined. Then K C P[K,M) and Ru{P{K, M) fl H) acts simply transitively 
on n{K, M). 

(ii) For g G Ng{H) we have n{gKg-\ gMg'^) = g ■ n{K,M) and P{gKg-\ gMg-^) = 
gP{K,M)g-^. If g E G normalizes H, K and Sn{M), then g G P{K,M). 

(iii) If fi e n{K,M), then dimC//(c^(ir)) > dimCiy(M). If M is H-conjugate to K, then 
n{K, M) = {0} and P{K, M) = G. If M is not H-conjugate to K, then K is not 
contained in L^ for any fi G Y{H) with P^ = P{K, M). 

Proof. We apply [6, Thm. 4.5] with (G', G, V, X, S) = {Ng{H), H, G", iT", 5„(M)). Since we 
associate to K and M an R-parabolic subgroup of G rather than H in loc. cit, we need to 
give some more arguments. 

(i) and (ii). The statements about fl(K,M) follow immediately from [6l Thm. 4.5]. Let 
fi G n{K,M). By P Thm. 4.5(iv)], R^{P^{H)) = Ru{P^,) nH acts simply transitively on 
Q{K, M). Hence = Pi, for all /x, G Q{K, M). The final assertion in (ii) is proved in the 
same way as the final assertion of [SI Thm. 4.5(iv)]. 

(iii). The proof of this is completely analogous to that of [6l Thm. 5. 16 (iii)]. Note that 
P{K, M) = G implies that Q{K, M) consists of the trivial cocharacter of H only. □ 

Remark 3.22. Note that Theorem 13.191 provides an obvious choice for the subgroup M in 
Theorem 13.211 for by Theorem 13.191 if we are given a subgroup K, then there is a unique 
conjugacy class of subgroups of the form M = C\{K) for A G Y{H) which are relatively 
G-cr with respect to H. Since these subgroups are all if-conjugate, the set 5'„(M) does 
not depend on which representative M we choose from this conjugacy class, and hence the 
optimal destabilizing R-parabolic subgroup P{K, M) of G also does not depend on the choice 
of M from this class. This leads to the following definition. 
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Definition 3.23. Let K be any subgroup of G, and let M be a representative from the 
i/-conjugacy class attached to K of subgroups which are relatively G-cr with respect to H, 
provided by Theorem [3H Define n{K) = Vt{K,M) and P{K) = P{K,M). By Theorems 
l3.19l and l3.2H K and Nnq(h){K) are contained in P{K) and for /i G ^{K), c^{K) is relatively 
G-completely reducible with respect to H. So, by Theorem I3.5( ii). if K is not relatively G- 
completely reducible with respect to H, then K is not contained in any R-Levi subgroup of 
P{K) of the form with /i G Y{H) and P^ = P{K). Note that, trivially, P{K) = G ii K 
is relatively G-completely reducible with respect to H. We call VL{K) the optimal class for 
K relative to H and P{K) the optimal destabilizing R-parabolic subgroup for K relative to 
H . In case H = G, we call P{K) the optimal destabilizing R-parabolic subgroup for K. 

Remark 3.24. One can give analogues of Theorem 13.211 and Definition 13.231 for a Lie subal- 
gebra t of g; note that one can work with generating tuples for t in place of generic tuples. 
We leave the details to the interested reader. 

Armed with Theorems 11.11 13.51 and 13.211 we can extend many results about G-complete 
reducibility within the framework of relative G-complete reducibility. In the following sub- 
sections we aim to illustrate interesting points of our new construction by looking at a 
selection of results, mainly from [2j; some of these results generalize immediately, while oth- 
ers are more subtle. We observe that all the results below have interpretations in terms of 
closedness of orbits in in view of Theorem 11.11 

3.7. New relatively G-completely reducible subgroups from old. In this subsection 
we explore how to generate new relatively G-cr subgroups from a given relatively G-cr 
subgroup M; for example, by taking suitable normal subgroups of M or looking at suitable 
subgroups of Ng{M). Our first result generalizes [21 Thm. 3.10], as the latter is simply the 
special case H = G of Theorem 13.251 The apparent direct analogue of [2, Thm. 3.10] in this 
context, namely that a normal subgroup of a subgroup M of G is relatively G-cr with 
respect to some reductive subgroup H of G provided M is, fails in general; see Examples 15.61 
and 15.71 below. 

Theorem 3.25. Let H be a reductive subgroup of G and let K and M be subgroups of G 
such that K (1 M ^ KN]sf^(^H){K) . If M is relatively G-completely reducible with respect to 
H , then so is K . 

Proof. We prove the contrapositive. So suppose K is not relatively G-cr with respect to 
H. Let P{K) be the optimal R-parabolic destabilizing subgroup for K with respect to 
H (Definition [323D- Then by Definition [S^Sl M C KNng{h){K) C P{K) and K is not 
contained in any R-Levi subgroup of P{K) of the form with yU G Y{H) and = P{K). 
Hence M cannot be contained in such an R-Levi subgroup of P{K), as K C M. Thus M is 
not relatively G-cr with respect to H. □ 

The following result generalizes the second statement of [21 Prop. 3.19]. 

Proposition 3.26. Suppose H is a reductive subgroup of G. Let K be a subgroup of G which 
is relatively G-completely reducible with respect to H , and suppose M is a reductive subgroup 
of G which contains K and is normalized by a maximal torus of Gh{K). Then M is also 
relatively G-completely reducible with respect to H . 
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Proof. Choose a maximal torus 5* of Ch{K) which normahzes M. Since MS is reductive 
and M C MS C MNh{M), we may assume that C M, by Theorem [S^Sl Let A e Y{H) 
be such that M <^ P\. Since M contains K and K is relatively G-cr with respect to H, we 
may assume that K C Lx. Then we have A(A;*) C Ch{K) fl Pa- But 5* is a maximal torus of 
Ch{K) n Pa, so there exists g G Ch{K) fl Pa such that ioi fi := g ■ \ we have /u(A;*) C S" C M. 
Clearly, we also have fieY{H) and Pf, = Px- Since M C Px = P^, we have P^(M) = M. 
Since M is reductive, this means that fi{k*) is central in M, by Definition 12.11 So M C L^, 
as required. □ 

Remark 3.27. Note that Proposition 13.261 applies in particular to reductive subgroups of 
G which contain all of KCh{K). In particular, if K is relatively G-completely reducible 
with respect to if, then, provided they are reductive, Ng{K) and KCg{K) are relatively 
G-completely reducible with respect to H. This generalizes [21 Cor. 3.16]; recall that Ng{K) 
and KCg{K) are automatically reductive if is a G-cr subgroup of G, cf. [21 Prop. 3.12]. 

The following result generalizes [21 Prop. 3.20]. 

Corollary 3.28. Let H be a reductive subgroup of G. Then any reductive subgroup of G 
which is normalized by a maximal torus of H is relatively G-completely reducible with respect 
to H. 

Proof. Let K he a. reductive subgroup of G which is normalized by a maximal torus of H. 
By Theorem I3.25[ we may assume that K contains a maximal torus S of H. Now S is H-cr 
[21 Lem. 2.6], so S is relatively G-cr with respect to H (Remark I3.2( ii)). The result follows 
from Proposition 13.261 applied to the inclusion S K. □ 

3.8. Relative G-complete reducibility with respect to different subgroups of G. 

In our next set of results we explore what happens when we vary the reductive subgroup 
H, rather than K. The first result generalizes one direction of [21 Prop. 2.8]. Note that 
the converse in this case is not true; just take any example of G, H and K where K is not 
relatively G-cr with respect to H, and let = {1}. 

Proposition 3.29. Suppose H is a reductive subgroup of G and N is a normal subgroup of 
H . For any subgroup K of G, if K is relatively G-completely reducible with respect to H , 
then K is relatively G-completely reducible with respect to N . 

Proof. First note that since H is reductive and is normal in if, is reductive. Suppose 
A G y{N) C Y{H) is such that K C Pa. Then, as K is relatively G-cr with respect to H, 
there exists u G Ru{Px{H)) such that K C uLxu~^ = L^-x, by Lemma [3.31 But u E H, so u 
normalizes A^, and thus m ■ A G ^(A^), and we are done. □ 

Corollary 3.30. Let H and K be subgroups of G such that H is reductive and K is relatively 
G-completely reducible with respect to H. Suppose M is a reductive subgroup of H which is 
normalized by Gh{K). Then K is relatively G-completely reducible with respect to M. 

Proof. Since Gh{K) normalizes M, M is normal in MGh{K). By Proposition I3.29[ if K is 
relatively G-cr with respect to MGh{K), then K is relatively G-cr with respect to M, so we 
may assume that Gh{K) C M. Let A G Y{M) such that K C Px. Then, as K is relatively 
G-cr with respect to H, there exists u G Ru{Px{H)) such that K C Lu-x, by Lemma 13.31 
But then m ■ A G Y{Gh{K)) C F(M), and we are done. □ 
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Our final proposition in this subsection is a strengthening of Proposition I3.17( i) and [5l 
Prop. 5.7]. Before we begin the build-up to the result, we note that it would be possible to 
adapt the proof of |5| Prop. 5.7] to prove our new result in positive characteristic. However, 
there are problems in characteristic zero: Prop. 5.7] is easy to prove in characteristic zero 
because of the nice characterization of G-complete reducibility in this case (a subgroup is G- 
cr if and only if it is reductive), but we have no such characterization of relative G-complete 
reducibility in characteristic zero, so we need a new proof. The following preparatory work, 
which is motivated by the notion of a generic tuple from Section 12. 4[ allows us to present a 
proof which is valid in any characteristic. 

Let W he a, finite-dimensional vector space over k and let n G N. We have an action of 
GL„ on W'"" given by 

A - {vi,...,Vn) = {v[,...,v'J, 

where 

n 

v'. = aijVj 
i=i 

and is the zj-component of A. This action of GL„ commutes with the diagonal GL(IV)- 
action on W"'. 

Recall the notion of a stable point from Definition 13. 12( and recall from Remark |3. 131 that 
if V is G-stable, then 

n-\n{v)) = G-v, 
where ir: V ^ V// G is the canonical morphism. 

Lemma 3.31. Let w = {wi, . . . ,Wn) € W'"' such that the Wi are linearly independent. Let 
F he a subgroup o/ GL„ such that F is a finite extension o/SL„. Then w is a stable point 
for the action of F on . 

Proof. Since the Wi are linearly independent, Cf{^) is trivial. It remains to check that F- w 
is closed. Let A G Y{F) such that lim A(a) ■ w exists. Choose A G GL^ such that A ■ A takes 

a— >-0 

values in the subgroup of F of diagonal matrices. Set w' = A ■ w = {w[, . . . ,w'^). Then 
lim (A ■ A) (a) ■ w' exists. There exist mi, . . . , m„ G Z such that for all a ^ k*, we have 

a-i>0 

{A ■ A)(a) ■ K, . . . , O = (a™^^, . . . , a'^-w'J. 
Since = SL„, we must have y^T-i = 0. As w', ^ and lim a"^'w', exists for each i, we 

must have > for each i. This forces all the mj to be zero, and so A ■ A is trivial, hence 
A is trivial. We conclude that F ■ w is closed, by the Hilbert-Mumford Theorem. □ 

Now suppose that dimly = n and w G W"' consists of a basis for W. Let g G GL(iy). 
Then g ■ w also consists of a basis for W. Hence there exists a unique element A{g, w) G GL„ 
such that 

(3.32) g ■ w = A{g, w) • w. 

Let w' G W"' be another basis for W. We can write w' = A ■ w for some A G GL„. Using 
the fact that the actions of GL(iy) and GL„, commute, a straightforward calculation shows 
that 

A{g,w')=AA{g,w)A-\ 
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Hence detA{g,w) is independent of w. Moreover, if g' G GL{W), then we have 



A{g'g,w) = A{g',g-w)A{g,w). 

It follows that the map 

GL{W) -^k\ g^ det A(^,w) 

is a homomorphism and is independent of w. 

We can now give our strengthening of Proposition 13. 17( i) and [5l Prop. 5.7]; note our new 
result is significantly stronger, since we do not require i^" to be a subgroup of CciS). In 
the case H = G, Proposition 13.331 and Corollary 13.341 identify instances where G-complete 
reducibility implies or is implied by relative G-complete reducibility with respect to a proper 
subgroup. 

Proposition 3.33. Let K, H and S be subgroups of G such that H is reductive and S 
normalizes H and K . Put M = Ch^S)^ . 

(i) Suppose that S is reductive and HS -completely reducible. Then M is reductive. More- 
over, K is relatively G-completely reducible with respect to H if it is relatively G- 
completely reducible with respect to M . 

(ii) Suppose that 

(a) [)/C(,(5') does not have any trivial S -composition factors; 

(b) ^{S) = UeCH{S); 

(c) M is reductive. 

Then K is relatively G-completely reducible with respect to M if it is relatively G- 
completely reducible with respect to H . 

Proof, (i). Suppose that S is reductive and HS-ci (note that HS is reductive, because H 
and S are). Then M is reductive, since Ch{S) is H-ci by [SI Thm. 5.4(a)]. Suppose that 
K is not relatively G-cr with respect to H. We show that K is not relatively G-cr with 
respect to M. Let Q{K) be the class of optimal cocharacters for K in H and let P{K) 
be the corresponding optimal destabilizing R-parabolic subgroup for K with respect to H 
(Definition [323]). By Theorem IMHii), since S C Ng{H) n Ng{K), we have S C P{K), 
and hence S normalizes P{K) HH. By [5l Lem. 5.1] (applied to the reductive group HS), S 
normalizes an R-Levi subgroup of P{K) fl if, and by [6l Thm. 4.5(iv)], this subgroup is of 
the form L\{H) for a unique A G VL{K). But S acts on VL{K), by Theorem 13. 21( ii). so 5* must 
fix A, and we have S ^ Lx = Cg'(A(/c*)). Hence A G Y{M). If K is contained in an R-Levi 
subgroup of Px{M), then K C L^.x{M) for some u G Ru{Px{M)). But then u G Ru{Px{H)), 
so K is contained in Lu.x{H), an R-Levi subgroup of M, which is impossible. We conclude 
that K is not relatively G-cr with respect to M either. 

(ii). After embedding G in some GL^, we may assume that G = GL^. Let E be the 
linear span of K in Matm. Let e G for some n be a basis for the associative algebra E. 
Then it follows from Theorem 13.101 that K is relatively G-cr with respect to H if and only 
if ii ■ e is closed, and likewise if we replace H by M. Before we proceed further, we briefly 
give the main idea of the proof. We want to apply [5| Thm. 5.4(b)] to e. We cannot do this 
directly, because S does not centralize K — it only normalizes K — and hence e need not 
be centralized by S. The point of the argument below, and of Lemma 13. 3H is to allow us 
to replace e with 7r(e), which is centralized by S; here vr : (Matm)" — > (Matm)"/i^ is the 
canonical projection, with F to be defined below. 
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Since S normalizes K, we have a homomorphism (p : S GL{E) and i?" is an 5'-stable 
subset of (Matm)" under the diagonal action. Define ip '■ S ^ k* hj ip{s) = det A{(p{s),e), 
where A{g,e) is as in Eqn. (13.321) . If ip{S) is finite, then we define F < GL„ by F = 
det~^ {-ipiS)). Now assume that ip{S) = k*. Let A < fc* be the subgroup of all roots of unity 
and for a positive integer / let A; < k* be the group of Zth roots of unity. Since A is dense in 
k* and the inverse image of a dense subgroup under a surjective homomorphism of algebraic 
groups is dense, we have that the ascending chain ip~^{Ai\)i>i of subgroups of S is dense 
in S. By similar arguments as in [Sj Prop. 3.7], we can now replace S by some ip~^{Ai\) 
without changing M and such that assumptions (a), (b) and (c) still hold. Now we are again 
in the situation that ^{S) is finite and again we define F < GL,„ by F = det~^(y9(5')). Let 
TT : (Matm)" — (Matm)"/-^ be the canonical projection. 

Now assume that K is relatively G-cr with respect to H. Let A G Y{M) such that e' : = 
lim A(a)-e exists. Since if- e is closed, we have e' G H-e. So 7r(e') = lim A(a)-7r(e) G H-7T{e). 

a— >0 a— >-0 

By our choice of F we have that for every s G S*, A{ip{s),e) G F. So 7r(e) is S'-fixed. Now 
M ■ 7r(e) is closed in H ■ 7r(e), by Thm. 5.4(b)], so 7r(e') G M ■ 7r(e). But then e' G M ■ e, 
by Lemma [3.311 and [HI Cor. 3.5(ii)]. So M-e is closed and thus K is relatively G-completely 
reducible with respect to M. □ 

We get the following analogue of [2| Cor. 3.21]. 

Corollary 3.34. Let G, H, K, S, and M = Ch{S)^ be as in Proposition \l_33i Suppose 
that S is linearly reductive. Then K is relatively G-completely reducible with respect to H if 
and only if it is relatively G-completely reducible with respect to M . 

Proof. Since S is linearly reductive, S is HS-cr [21 Lem. 2.6] and conditions (a)-(c) of Propo- 
sition [HSSIii) all hold f2T\ Lem. 4.1, Prop. 10.1.5]. The result now follows from Proposition 
EM □ 

Remark 3.35. In [21 Thm. 5.8] and [17], there is a similar construction with the matrices 
A{g,w) replaced by permutation matrices. The construction above extends this idea. 



4. Rationality questions 

There is an obvious way to extend the notion of relative G-complete reducibility by con- 
sidering non-algebraically closed fields. Throughout this section, k denotes any field and 
we assume that G is a reductive fc-group. Furthermore, we assume that if is a reductive 
fc-defined subgroup of G. We let ks denote the separable closure of k, and k the algebraic 
closure of k. We denote the Galois group Gal{ks/k) = Gal(/c//c) by F. Algebraic groups and 
varieties will always be defined over k and points will always be fc-defined points. If V is 
a fc- variety and ki/k is an algebraic extension, then we denote the set of fci-points of V by 
V{ki). We call elements of V{ks) separable points. Note that F acts on ^ = V{k). A closed 
subvariety of K is defined over k if and only if it contains a F-stable set of separable 
points of V which is dense in W; see [3 Thm. A. 14. 4]. The set of /c-defined cocharacters of 
a k-group K is denoted Yk{K). We say that a G- variety V is defined over k if both V and 
the action of G on \^ are defined over k. 

We begin with the definition of relative G-complete reducibility over k: 
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Definition 4.1. Let K he a. subgroup of G. We say that K is relatively G -completely 
reducible over k with respect to H if for every A G Y{H) such that Pa is /c-defined and 
K <^ Px, there exists /x G Y{H) such that P\ = P^, is A;-defined and K C L^. 

In order to deal with the definition of relative G-complete reducibility over k, we need 
some more detailed information about R-parabolic subgroups defined over k. 

Lemma 4.2. Let A G Y{H). If Px is k-defined, then Px{H) is k-defined. The analogous 
assertions hold for Lx and Ru{Px)- 

Proof Thanks to [28l Prop. 12.1.5], Px{H) = PxHH is A;-defined if Lie Px{H) = Lie Pa n 
Lie if; similarly for Lx and P„(Pa). The result now follows from Lemma [3.81 applied to G 
and H. □ 

Remark 4.3. It follows from Lemma [4.21 and [6l Lem. 2.5] that if A G Yk{H), then Pa, Lx, 
Ru{Px), Px{H), Lx{H) and Ru{Px{H)) are fc-defined. 

Lemma 4.4. Let A G Y{H) and assume that Px is k-defined. Then there exists fi G Y^^H) 
such that Px C P^ and Px= Pj^- 

Proof. This follows from the proof of [6, Lem. 2.5(ii)], replacing the maximal torus of Pa 
with a maximal torus of Px{H). □ 

Remark 4.5. It is not true that any k-defined R-parabolic subgroup of G stems from a 
cocharacter defined over k; see P, Rem. 2.4]. 

The next lemma gives a version of Lemma [X^ i) over k. Note that any two /c-defined R-Levi 
subgroups of a fc-defined R-parabohc subgroup are P„(P)(A;)-conjugate P, Lem. 2.5(iii)]. 

Lemma 4.6. Let A,/i G Y{H) such that Px = P^ and let u he the element of Ru{Px{H)) 
such that uLx{H)u~^ = L^{H). Then uLxu~^ = L^. Furthermore, if G, H, Px, Lx and Lfj, 
are k-defined, then u G Ru{Px{H)) (k) . 

Proof. The first part of this is Lemma [3.31 The final assertion follows from [51 Lem. 2.5(iii)] 
and the fact that Ru{Px{H)){k) = Ru{Px{H)) n P„(Pa)(A;). □ 

Corollary 4.7. Let A G Yk{H) and let /i G Y{H) such that Px = P^ and Lfj_ is k-defined. 
Then there exists v G Yk{H) such that Px = Py and L^ = L^. 

Proof. By Lemma there exists u G Ru{Px{H)){k) such that L^.a = uLxu~^ = L^, so we 
can take u = u ■ X. □ 

We can now show that when discussing relative G-complete reducibility over k, it suffices 
to consider R-parabolic subgroups of the form Pa with A G Yk{H), rather than all /c-defined 
R-parabolic subgroups stemming from a cocharacter of H. 

Lemma 4.8. Let K be a subgroup of G. Then K is relatively G-completely reducible over 
k with respect to H if and only if for every A G Yk{H) such that K is contained in Px, there 
exists fi G Yk{H) such that Px = P^ and K C L^. 

Proof. This follows from the proof of P, Lem. 5.2], using Corollary 14. 71 in place of [HI Cor. 2.6]. 

□ 
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In order to generalize Theorem II. II to arbitrary fields, we need a notion of a "closed orbit" 
for a group M{k) of fc-points of a reductive fc-group M acting on a fc-variety. As we shall 
show, the correct notion for us is given by the following definition, see [61, Def. 3.8]: 

Definition 4.9. Let M be a reductive /c-group and let V be an M-variety defined over k. 
Let V & V. We say that the M(/c)-orbit M{k) ■ v is cocharacter-closed over k if for any 
A G Yk{M) such that v' := lima^o ^{cl) ' ^ exists, v' is M(/c)-conjugate to v. Note that it 
follows from the Hilbert-Mumford Theorem that M ■ f is closed if and only if M(A;) ■ f is 
cocharacter-closed over k. 

For the proof of Theorem 14.121 we need the following two extensions of Theorem 12.41 to 
non-algebraically closed fields. The first result is [HI Thm. 3.3]. Here we require the field to 
be perfect. 

Theorem 4.10. Suppose k is a perfect field. Let M he a reductive k-group and let V be an 
M-variety defined over k. Let v ^ V and let A G Yk(M) such that v' := limA(a) ■ v exists 

a-i>0 

and is M{k)- conjugate to v. Then v' is Ru{Px{M)){k)- conjugate to v. 

The second result is (Gj Thm. 3.10]. Here we require M to be connected and the two 
assertions need to be quantified over all fc-defined cocharacters from M. 

Theorem 4.11. Let M be a connected reductive k-group and let V be an M-variety defined 
over k. Let v & V . Then the following are equivalent: 

(i) M{k) ■ V is cocharacter-closed over k; 

(ii) for all A G Yk(M) such that v' := limA(a) -v exists, v' is Ru(Px(M))(k)- conjugate to v. 

Using the preceding discussion, we can now extend parts of Theorem l3.5l to non-algebraically 
closed fields. The final assertion in part (iii) is the desired extension of Theorem 11.11 to ar- 
bitrary fields. Note that this equivalence also generalizes [G', Thm. 5.9]. 

Theorem 4.12. Let H be a reductive k-defined subgroup of G. 

(i) Let n G N, let k G G" and let A G Y^^H) such that m = lima^o ^i^i) " k exists. Then 
the following are equivalent: 

(a) m is Ru{P\{H)){k) -conjugate to k; 

(b) there exists /i G Yk{H) such that P\ = P^ and nik*) fixes k. 

If k is perfect, then (a) and (b) are also equivalent to the following: 

(c) m is H{k)- conjugate to k. 

(ii) Let K be a subgroup of G and let A G Yk{H). Suppose K C P^^ and set M = cx{K). 
Then the following are equivalent: 

(a) M is Ru{P\{H)){k) -conjugate to K; 

(b) K C for some /i G Yk{H) such that P\ = P^. 

(iii) Let K , A and M be as in (ii) and let k G K'"- be a generic tuple of K. Then the assertions 
in (i) are equivalent to those in (ii). Furthermore, K is relatively G- completely reducible 
over k with respect to H if and only if H^{k) ■ k is cocharacter-closed over k. 

Proof, (i) and (ii). The equivalence of (a) and (b) in both cases follows from Lemmas 12.31 
and 14.61 The equivalence of part (a) and part (c) in (i) follows from Theorem 14.101 

(iii). The equivalence of (i)(b) and (ii)(b) follows from Lemma [2.6( ii). so (i) and (ii) are 
equivalent. For the final assertion of (iii) we can assume H is connected, by Remark 13. 2( i). 
Now we use Theorem 14.111 and the equivalence of (i) and (ii). □ 
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The following result extends [6| Thm. 5.11] to our setting of relative G-complete reducibil- 
ity. The proof is completely analogous to the proof given in loc. cit. 

Theorem 4.13. Suppose ki/k is a separable extension of fields. Let K he a k-defined 
subgroup of G. If K is relatively G-completely reducible over ki with respect to H, then K 
is relatively G-completely reducible over k with respect to H . 

We end this section with a converse of Theorem 14 .131 in case k is perfect. For this one needs 
an extension to arbitrary k of the results on optimal parabolic subgroups from Section 13.61 
We briefly indicate how to set this up. 

First, we adapt some of the notation from [21 Sec. 4, Sec. 5] to the relative setting over k. 
Suppose K is a. subgroup of G and suppose A G Yk{H) is such that K C P^. Set M := C\{K) 
and, as in Section [3^ let Sn{M) = H ■ M"-. Then K"^ is uniformly 5'„(M)-unstable over k 
for the action of H on G" in the sense of |6l Def. 4.2]. Any G(A;)-invariant norm on Yk{G) in 
the sense of [Gj Def. 4.1] restricts to an iVG(fe) (i? )-invariant norm on Yk{H); let || || be such 
a norm. Then [6l Def. 4.4] provides an optimal class Q{K"', Sn{M), k) C Yk{H) of fc-defined 
cocharacters of H. 

With these preliminaries in hand, it is straightforward to derive analogues of [6, Thm. 5.16], 
[6l Def. 5.17] and [6| Thm. 5.18] in the relative setting. The first result is derived as follows: 
let N be the closure in G of NG{ks){H). Then is a fc-defined closed subgroup of Ng{H), 
H is a normal subgroup of N, and A^(A;) = NG(^k){H). Now apply [6, Thm. 4.5] with 
{G',G,V,X,S) = {N,H,G'',K'',Sn{M)). For the second result, one needs to choose an 
A^-invariant fc-defined norm on Y{H). 

Theorem 4.14. Suppose ki/k is an algebraic extension of perfect fields. Let K be a k- 
defined subgroup of G. If K is relatively G-completely reducible over k with respect to H, 
then K is relatively G-completely reducible over ki with respect to H . 

Proof. By Theorem I4.13[ we may assume that ki = k. Suppose K is not relatively G- 
completely reducible with respect to H. Then K is not contained in any R-Levi subgroup 
of the optimal destabilizing R-parabolic subgroup P{K) with respect to H. Now P{K) is 
fc-defined by the analogue of [6|, Thm. 5.18(ii)] so K is not G-completely reducible over k 
with respect to H. □ 

Remark 4.15. We do not know whether Theorem 14. 141 holds for an arbitrary separable alge- 
braic field extension ki/k. For further discussion, see [6l Ex. 5.21] and [H Rem 1.2]. 

Remark 4.16. The results in this section have obvious counterparts for Lie algebras. We 
leave the details to the reader. 

5. Examples and counterexamples 

5.1. Relative GL(K)-complete reducibility. Now we investigate the concept of relative 
complete reducibility in case the ambient reductive group is a general linear group. 

Let be a finite-dimensional fc- vector space and set G = GL(V^). Recall that if K is 
a subgroup of G, then K is G-cr if and only if is a semisimple module for K. In this 
subsection we give an analogous interpretation for relative G-complete reducibility with 
respect to a smaller general linear group H inside G. 
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Proposition 5.1. Let U be a subspace of V, and pick a direct complement U to U. Let 
H = GL{U) C G embedded in the obvious way. Let K be a subgroup of G = GL(V^). Then 
K is relatively G-completely reducible with respect to H = GL{U) if and only if the following 
two conditions hold: 

(i) every K-submodule of V contained in U has a K- complement in V containing U; 

(ii) every K-submodule of V containing U has a K- complement in V contained in U. 

The proof is straightforward and we leave it as an exercise for the reader. 

Remarks 5.2. (i). Note that conditions (i) and (ii) in Proposition 15.11 are "dual" to each 
other in the sense that the complement in (i) is a submodule of the form in (ii), and vice 
versa. One considers only those decompositions of as a direct sum of ii'-submodules that 
are compatible with the fixed decomposition V = U (B U (even though U and U are not 
required to be iiT-stable!). Even in the very special case considered in Proposition 15.11 the 
concept of a relatively completely reducible subgroup of GL{V) appears to be new. 

(ii) . Note that for H = G in Proposition 15.11 we recover the fact that K is GL(y)- 
completely reducible if and only if is a semisimple i^-module. 

(iii) . Fixing the complementary subspace U to U in Proposition 15.11 fixes the embedding 
of H in G. Note that this is crucial, as the result depends on the choice of U. To see this, 
consider the special case that K acts completely reducibly on V and f/ is a i^"-submodule of 
V. Then it follows from Proposition 15.11 that K is relatively G-cr with respect to H if and 
only if U is also a if-submodule. 

We can refine Proposition 15 . 1 1 to show more accurately how the conclusion depends on the 
structure of ^ as a /T-module, and how this interacts with the subspace U. To do this, we 
first define two operations on the set of subspaces of V. Firstly, for any subspace W <^ V, 
let <7KiW) be the i^-submodule of V generated by the submodules contained in W; note 
o'xiW) C W. Secondly, let lk{W) denote the smallest ii"-submodule of V containing W 
(i.e., the intersection of all such submodules). Then we have the following result. 

Proposition 5.3. Let G, U, U, H and K be as in Proposition \5.1[ Then K is relatively 
G-completely reducible with respect to H if and only if the following two conditions hold: 

(i) (Jk{U) is a completely reducible K -module; 

(ii) V = aK{U)®iK{U)- 

Proof. Suppose K is relatively G-cr with respect to H. We first show (i). Let be a K- 
submodule of axiU). Then 14^ C f/, so there exists a K-submodule W ^ U with V = WQ)W, 
by condition (i) of Proposition 15.11 Then W fl (Jk{U) is a i^'-complement to W in axiU). 

We now show (ii). By condition (i) of Proposition 15. H since (Jk{U) is a i^-submodule 
contained in [/, there exists a i^'-complement to crxiU) containing U. Since Lk{U) is the 
smallest such i^-submodule, we must have <7k{U) fl lk{U) = {0}. By condition (ii) of 
Proposition 15. Ij since lk{U) is a i^'-submodule containing U, there exists a i^'-complement 
to lk{U) contained in U. Since <7k{U) is the largest such i^-submodule, we must have 
aK{U) + iK{U) = V. 

Now suppose (i) and (ii) hold. If is a i^-submodule of V contained in U, then W C 
axiU), by definition. By (i), there exists a ii"-complement W to W in axiU). Then 
W © lk{U) is a i^-complement to 1^ in containing [/, by (ii), giving condition (i) of 
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Proposition 15.11 If is a -R'-submodule of V containing U, then W 3 lk{U), by definition. 
Let W be a i^'-complement to n <7k{W) in axiW). Then W' is a f^-complement to 
in V contained in U, giving condition (ii) of Proposition 15.11 □ 

The following result gives a necessary condition for a subgroup to be relatively G-cr with 
respect to a Levi subgroup of G in terms of the corresponding direct sum decomposition of 
V: 

Corollary 5.4. Suppose L is a Levi subgroup of G = GL{V), with corresponding decompo- 
sition V = Ui (B ■ ■ ■ Q) Us- Let K be a subgroup of G. Then if K is relatively G-completely 
reducible with respect to L, the following two conditions hold for each i: 

(i) every K-submodule ofV contained in Ui has a K -complement containing ^j^^Uj; 

(ii) every K-submodule ofV containing ©^yj f/j has a K -complement contained in Ui. 

Proof. We have L = GL(f/i) x ■ ■ ■ x GL(f/s). If K is relatively G-cr with respect to L then 
Proposition 13.291 implies that K is relatively G-cr with respect to GL{Ui) for each i. The 
result now follows from Proposition 15.11 □ 

5.2. More examples and counterexamples. 

Remark 5.5. We noted in Remark I3.2( iv) that in general a relatively G-cr subgroup need 
not be reductive. However, one can ensure that it is reductive under suitable conditions. For 
example, if if is a maximal rank reductive subgroup of G and if is a subgroup of G which is 
relatively G-completely reducible with respect to H and which is normalized by a maximal 
torus of H, then K is reductive. The special case of this result when if = G is due to Serre, 
[271 Prop. 4.1], and one can follow his argument to prove the result in the relative setting. 
We leave the details to the reader. 

We noted at the beginning of Section [XTl that the direct analogue of [21 Thm. 3.10], namely 
that a normal subgroup of a subgroup M of G is relatively G-cr with respect to some 
reductive subgroup H of G provided M is, fails in general. We now present two examples 
which demonstrate this failure. 

Example 5.6. Let char A; be arbitrary. Let G = GL3 and let H be the image of SL2 
embedded in G by A i— t- ( — ^ ] . Let T be the standard maximal torus of G consisting 



A 



of the diagonal matrices in G. Let a and (3 be the standard simple roots of G with respect 
to T (corresponding respectively to the (2, 3)- and (1, 2)-entries of matrices in G). Let B be 
the Borel subgroup of G consisting of upper triangular matrices in G. Put K = UpUa+p- 
Then K is relatively G-cr with respect to if, but the normal subgroups Up and Ua+p of K 
are not. 

Take for example = Ua+13 and define A G Y[H) by A(a) = diag(l, a, a~^). Then C P^, 
which is a Borel subgroup of G. Clearly, is not contained in any Levi subgroup of Pa, 
since A^ C i?„(P_x)- So Ua+i^ is not relatively G-cr with respect to H. The argument for [/^ 
is similar; replace A with —A. 

Now we show that K is relatively G-cr with respect to H by showing that A 6 y{H) 
and H <^ Px implies that A = 0. Let A G Y{H). We can find h E H such that fi := h ■ X 
is in diagonal form. Then we have for x E K that lim A(a)xA(a)~^ exists if and only if 

a— s>0 
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lim ^(a)hxh ^yu(a) ^ exists. Since K is stable under conjugation by H, we may now assume 

a-i>0 

that A is in diagonal form, that is, A(a) = diag(l, a", a~") for some integer n. It is now 
straightforward to show that n = 0. 

The next example shows that a connected reductive normal subgroup of a connected 
reductive group that is relatively G-cr with respect to H need not be relatively G-cr with 
respect to H. 

Example 5.7. Suppose p = 2. Let Vi and V2 be copies of the vector space k"^ and let 
Hi = H2 = k* X SL2. We identify Hi and H2 with subgroups of Hi x H2. Define 6i G Y{Hi) 
by 6i{x) = {x,I), where I is the identity matrix in SL2. Define an action of Hi x H2 on 
Vi © V2 by 

((Xi, Ai), (X2, A2)) ■ {Vi, V2) = {x^^AiVi, Xi^A2V2), 

where AiVi denotes the usual matrix product. We choose an embedding of {H1XH2) x (Vi©V2) 
inside a reductive group G. Let TCi: Hi x Vi Hi be the canonical projection. Let Mi be 
the copy of SL2 inside Hi. We can choose a copy Ni of PGL2 inside Mi x Vi such that 
T^i{,Ni) = Mi but Ni is not {Hi x V^)-conjugate to a subgroup of Hi; to see this, note that 
the image of the adjoint representation of SL2 in GL3 lies in [P,P], where P is a maximal 
parabolic subgroup of GL3, and [P, P] is isomorphic to Mj x ^, so we can take Ni to be this 
image. 

Let H = {{{xi,Ai),{x2,A2)) G Hi x H2\x2 = x^^} and set K = N1N2. Then K is 
isomorphic to A^i x A^2; since A^^i and N2 commute with each other and have disjoint Lie 
algebras. So is a connected reductive group and Ni,N2 are connected normal subgroups 
of K. We show that K is relatively G-cr with respect to H but A^^i and N2 are not. 

Let A G Y{H) such that K C P^. We can write A = Ai + A2 where Ai G Y{Hi). We 
have Ni C P^. Now Z{Hi) C Px because Z{Hi) centralizes the image of A. Since Z{Hi) 
acts trivially on Mj and acts non-trivially as multiplication by scalars on Vi, it is clear that 
Mi and the non-trivial subgroup Ui of Vi generated by the set {ni^n) \n G Ni} are both 
contained in Px. Because Mj does not lie in a proper parabolic subgroup of Hi, we must 
have A = ni6i + ^2(52 for some ni,n2 G Z. We must have ni + ^2 = by our choice of H. 
We have \{x)viX{x)~^ = x~^'^Vi for vi G Vi and A(x)u2A(x)~^ = x~"^f2 for V2 G V2. Since 
the non-trivial subgroups Ui and U2 lie in Px, this forces ni = n2 = 0. Hence A is the trivial 
cocharacter and we conclude that K is relatively G-cr with respect to H . 

A similar argument shows that A^i C Px and Ui C Ru{Px), where \ = 5i — 82. It follows 
that ca(A'^i) = Ml. Now A^^i is not if-conjugate to Mi, and this implies by Theorem I3.5( ii) 
that A^^i is not relatively G-cr with respect to H. Similarly, N2 is not relatively G-cr with 
respect to H. 
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